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(54) Image display system, information processing apparatus, and method of controlling the 
same 



(57) Astereoscopic image display apparatus for dis- 
playing a stereoscopic image, which is obtained by al- 
ternately arranging stripe parallax images R and L cor- 
responding to the right and left eyes, in a window in- 
cludes a parallax barrierfor astereoscopic vision. When 
the display position of a window including a stereoscopic 



image which is set after the window is opened or moved 
and the positions of the right-eye and left -eye stripes of 
a parallax barrier have a relationship which does not al- 
low a proper stereoscopic vision, the display position of 
the window is moved by one stripe in the horizontal di- 
rection. 
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Description 

BACKGROUND OF THE INVENTION 

FIELD OF THE INVENTION . 

-'- The present invention relates to a stereoscopic dis- 
play apparatus which allows an observer to observe a 
stereoscopic image by using the parallax between the 
right and left eyes, an information processing apparatus, 
a host computer for controlling the display apparatus, 
and a method therefor, thereby providing an operation 
environment for comfortable stereoscopic display. 

RELATED BACKGROUND ART 

In general, a stereoscopic image display apparatus 
of the parallax barrier scheme is known well as an ap- 
paratus for displaying a stereoscopic image. The paral- 
lax barrier scheme is disclosed in S. H. Kaplan, "Theory 
of Parallax Barriers.", J. SMPTE, Vol. 59, No. 7, pp. 11 
- 21 (1 952). According to this scheme, a striped image 
obtained by alternately arranging at least right and left 
images of a plurality of parallax images from a plurality 
of viewpoints into a vertically striped pattern is observed 
through a slit pattern (called a parallax barrier) having 
predetermined opening portions placed at a predeter- 
mined distance from this image. With this operation, the 
observer observes images corresponding to the respec- 
tive eyes with the corresponding eyes. Japanese Patent 
Laid-Open Nos. 3-119889 and 5-122733 disclose ster- 
eoscopic display apparatuses in which a parallax barrier 
is electronically generated by a transmission type liquid 
crystal display device and the like, and the shape and 
position of each stripe are variably controlled to improve 
the compatibility with conventional 2D image display ap- 
paratuses. 

Fig. 19 shows the basic arrangement of the stere- 
oscopic image display apparatus disclosed in Japanese 
Patent Laid-Open No. 3-119889. This stereoscopic im- 
age display apparatus includes a transmission type liq- 
uid crystal display apparatus 101 for displaying images 
and an electronic parallax barrier 1 03 constituted by a 
transmission type liquid crystal display placed on the liq- 
uid crystal display apparatus 101 sandwiching a spacer 

102 having a thickness d. 

The transmission type liquid crystal display appara- 
tus 101 displays a vertically striped image consisting of 
parallax images sensed from two or more directions. A 
parallax barrier pattern is formed at an arbitrary position 
on the barrier surface of the electronic parallax barrier 

103 upon designation of X and Y addresses by a control 
means such as a microcomputer, thereby allowing a 
stereoscopic vision based on the principle of the above 
parallax barrier scheme. Note that when this electronic 
parallax barrier is made colorless and transparent 
throughout the entire image display area, a 2D image 
can be displayed, thus realizing the compatibility be- 



tween the 2D display and 3D display. 

An apparatus capable of performing mixed display 
of 3D and 2D images within a single frame is disclosed 
in Japanese Patent Laid-Open No. 5-1 22733. In this ap- 
s paratus, as shown in Figs. 20Aand20B, a striped barrier 
pattern can be generated only in a partial area of the 
electronic parallax barrier 103. 

The lenticular scheme is also known widely as a 
means for displaying a stereoscopic image by using the 
10 parallax between the right and left eyes of an observer 
as in the parallax barrier scheme. In the lenticular 
scheme, a lenticular lens constituted by an array of 
many semicylindrical lenses is placed on the front sur- 
face of a display to spatially separate an image into im- 
is ages for the right and left eyes, thereby allowing the ob- 
server to observe a stereoscopic image. In the display 
of the lenticular scheme as well, an image displayed on 
the screen is a vertically striped image obtained by al- 
ternately arranging right and left images. 
20 As a stereoscopic display using a horizontally 
striped image obtained by alternately arranging right 
and left images, Cyberbook (trademark) is available 
from Vrex Inc. In this display, as shown in Fig. 21, a 
striped polarizing plate 202 obtained by alternately ar- 
2S ranging two types of polarizing plates, whose polariza- 
tion axis directions are perpendicular to each other, in 
units of horizontal lines is placed on the front surface of 
the liquid crystal display of a notebook personal compu- 
ter 201 . A displayed image is observed through polari- 
so zation glasses 203 having the two types of polarizing 
plates corresponding to those used for the striped po- 
larizing plate 202 arranged for the right and left eyes. 
(In Fig. 21 , the arrows indicate polarizing direction of the 
polarizing direction of the polarizing plates.) With this 
35 arrangement, of the displayed image, lines to be seen 
with the right and left eyes of the observer can be sep- 
arated/selected. For example, the odd lines of the liquid 
crystal display are used a right-eye image display lines, 
and the even lines are used as left-eye image display 
4o linestoallowtheobservertoseparately observe images 
formed by the respective lines with the corresponding 

Various environments in which 3D displays are 
used can be conceived. Assume that an entire screen 
45 is occupied by a single type of image as in the case of 
a television set. In this case, the relative positional rela- 
tionship between a displayed image and each constitu- 
ent element of the apparatus always remains the same. 
Once, therefore, the observer sets his/her eyes at an 
50 optimal observation position, he/she can continuously 
obtain a proper stereoscopic vision. Assume that a plu- 
■ rality of windows are opened on one screen, and images 
are to be displayed in the respective windows like imag- 
es handled in a computer. In this case, as the positions 
55 of the windows change, the relationship between each 
image and each constituent element of the apparatus 
changes. As a result, the optimal observation position 
changes, and hence the observer cannot always obtain 
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a proper stereoscopic vision. 

When, for example, a barrier 1 of the parallax barrier 
scheme and a striped image 2 displayed on the image 
display apparatus maintain a proper relative positional 
relationship, as shown in Fig. 22, light forming an image 
for the left eye propagates to a left eye 3, and light form- 
ing an image for the right eye propagates to a right eye 
4. As a result, Ihe observer can properly recognize a 
stereoscopic image. 

If, however, the relative positions of the barrier 1 and 
the striped image 2 displayed on the image display ap- 
paratus are shifted by one pitch in the horizontal direc- 
tion with respect to the positions in Fig. 22, as shown in 
Fig. 23, light forming an image for the left eye propa- 
gates to the right eye 4, and light forming an image for 
the right eye propagates to the left eye 3. As a result a 
"reversed stereoscopic vision" for the observer is pro- 
duced. 

When a plurality of windows are opened, and ster- 
eoscopic images are displayed in the respective win- 
dows, in particular, stereoscopic visions may be proper- 
ly produced in some windows, but reversed stereoscop- 
ic visions may be produced in other windows. 

When windows are opened, and images are dis- 
played in the respective windows in this manner, since 
the relative positions of the barrier 1 and the striped im- 
age 2 are likely to change, the possibility of the occur- 
rence of a reversed stereoscopic vision is high This ten- 
dency applies to any stereoscopic display scheme, as 
well as the parallax barrier scheme, in which the relative 
positional relationship between a displayed image and 
other optical parts is important. 

The same applies to Cyberbook available from 
Vrex, which uses a "horizontally striped" parallax image 
as a striped image. In this case, when, for example, the 
relative positions of a striped polarizing plate and a 
striped image displayed on the image display apparatus 
are shifted by one pitch in the vertical direction, a re- 
versed stereoscopic vision is produced. 

SUMMARY OF THE INVENTION 

The present invention has been made in consider- 
ation of the above problems, and has as its object to- 
provide an image display system and an information 
processing apparatus which can always allow a proper 
stereoscopic vision by controlling the arrangement of 
the stripe parallax images of a stereoscopic image dis- 
played in a window to be suited to a display apparatus, 
and a method of controlling the system and the appara- 
tus. 

It is another object of the present invention to pro- 
vide an information processing apparatus and method 
which can always allow an observer to have a proper 
stereoscopic vision even with a change in the position 
of each window when several windows are opened on 
the screen, and images are displayed in the windows 
like images handled in a computer. 



It is still another object of the present invention to 
allow a stereoscopic vision in units of windows. 

It is still another object of the present invention to 
always allow a proper stereoscopic vision without 
£' changing the contents displayed in a window. 

It is still another object of the present invention to 
always allow a proper stereoscopic vision without 
changing the display position of a window. 

It is still another object of the present invention to 
10 allow a proper stereoscopic vision while a window is 
moved. 

According to an aspect of the present invention, in 
order to achieve the above objects, there is provided an 
image display system capable of performing stereo- 
15 scopic display, comprising stereoscopic image display 
meansfor displaying a stereoscopic image having stripe 
parallax images arranged for right and left eyes, stere- 
oscopic vision control means for controlling directivity of 
the stereoscopic image such that stripe images of the 
20 stereoscopic image are respectively observed with the 
right and left eyes, and changing means for, when a rel- 
ative positional relationship between the stereoscopic 
image and the stereoscopic vision control means is not 
a proper relationship with which an observer can obtain 
25 a proper stereoscopic vision, changing the relative po- 
sitional relationship to realize a proper stereoscopic vi- 
sion. 

According to another aspect of the present inven- 
tion, there is provided an information processing appa- 
30 ratus which can be connected to an image display ap- 
paratus having stereoscopic vision control means for 
controlling directivity of a stereoscopic image to allow 
an observerto observe stripe images of the stereoscop- 
ic image with right and left eyes of the observer, respec- 
35 tively, comprising generation means for generating im- 
age data including a window in which stripe parallax im- 
ages corresponding to the right and left eyes are ar- 
ranged, determination means for determining whether 
a relative positional relationship between the window 
40 and the stereoscopic vision control means of the image 
display apparatus is a proper positional relationship 
which allows a proper stereoscopic vision, and adjust- 
ment means for, when the determination means deter- 
mines that the relationship is not the proper relationship 
45 which allows a proper stereoscopic vision, adjusting the 
relative positional relationship to allow a proper stereo- 
scopic vision. 

According to still another aspect of the present in- 
vention, there are provided control methods for the 
so above image display system and information process- 
ing apparatus. 

Other features and advantages of the present in- 
vention will be apparent from the following description 
taken in conjunction with the accompanying drawings, 
55 in which like reference characters designate the same 
or similar parts throughout the figures thereof. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporat- 
ed in and constitute a part of the specification, illustrate 
embodiments of the invention and, together with the de- 
scription, serve to explain the principles of the invention. 

Fig. 1 is a block diagram showing the arrangement 
of a computer system according to the first embod- 
iment of the present invention; 
Fig. 2 is a view showing an image for the left eye; 
Fig. 3 is a view showing an image for the right eye; 
Fig. 4 is a view showing a vertically striped parallax 
image obtained by dividing the parallax images in 
Figs. 2 and 3 into vertical stripes, and alternately 
arranging them; 

Fig. 5 is a view showing a horizontally striped par- 
allax image obtained by dividing the parallax imag- 
es in Figs. 2 and 3 into horizontal stripes, and alter- 
nately arranging them; 

Fig. 6 is a view showing a state in which the posi- 
tions of right and left stripe images defined by a di- 
rectivity control means in accordance with the dis- 
play position of a window for displaying a stereo- 
scopic image coincide with the right and left stripes 
of the stereoscopic image; 
Fig. 7 is a view showing a state in which the posi- 
tions of right and left stripe images defined by a di- 
rectivity control means in accordance with the dis- 
play position of a window for displaying a stereo- 
scopic image do not coincide with the right and left 
stripes of the stereoscopic image; 
Fig. 8 is a flow chart showing an operation proce- 
dure performed by a host computer in the first em- 
bodiment; 

Fig. 9 is a view for explaining fine adjustment of a 
window position for a vertically striped parallax im- 
age; 

Fig. 10 is a view for explaining fine adjustment of a 
window position for a horizontally striped parallax 
image; 

Fig. 11 is a flow chart showing an operation proce- 
dure performed by a host computer in the second 
embodiment of the present invention; 
Fig. 12 is a view for explaining how the contents of 
a displayed image in a window are changed in the 
second embodiment; 

Fig. 1 3 is a view for explaining how the contents of 
a displayed image in a window are changed in the 
second embodiment; 

Fig. 14 is a view for explaining how the contents of 
a displayed image in a window are changed in the 
second embodiment; 

Fig. 15 is a view for explaining how the contents of 
a displayed image in a window are changed in the 
second embodiment; 

Fig. 16 is a view for explaining how the contents of 
a displayed image in a window are changed in the 



second embodiment; 

Fig. 17 is a flow chart showing a control procedure 
performed by a host computer in the third embodi- 
ment of the present invention; 

s Fig. 18 is a flow chart showing a control procedure 
for preventing a reversed stereoscopic vision during 
a window dragging operation in the fourth embodi- 
ment o[ the present invention; 
Fig. 1 9 is a view showing the basic arrangement of 

io the stereoscopic image display apparatus dis- 
closed in Japanese Patent Laid-Open No. 
3-119889; 

Figs. 20A and 20B are views for briefly explaining 
the stereoscopic image display apparatus dis- 
ts closed in Japanese Patent Laid-Open No. 
5-122733; 

Fig. 21 is a perspective view for briefly explaining a 
stereoscopic image display apparatus using Cyber- 
book (trademark); 
so Fig. 22 is a view showing a state in which the relative 
positions of a barrier and a striped image in the par- 
allax barrier scheme have a proper relationship; 
and 

Fig. 23 is a view showing a state in which the relative 
25 positions of the barrier and the striped image in the 
parallax barrier scheme have an improper relation- 

DETAILED DESCRIPTION OF THE PREFERRED 
30 EMBODIMENTS 

Preferred embodiments of the present invention will 
now be described in detail in accordance with the ac- 
companying drawings. 

35 

<Firsl Embodiment 

Each of the following embodiments will exemplify a 
stereoscopic display apparatus for allowing an observer 

40 to observe a stereoscopic image by using the parallax 
between the right and left eyes and a computer system 
includinga host computer for controlling the stereoscop- 
ic display apparatus. 

Fig. 1 is a block diagram showing the arrangement 

45 of a computers/stem according to the first embodiment. 
Referring to Fig. 1 , reference numeral 1 0 denotes a host 
computer; 20, a stereoscopic display apparatus; 11, a 
CPU for realizing various types of control operations 
performed by the host computer 10; 12, a ROM storing 

SO a boot program, which is executed when the CPU 11 is 
started, and various types of data; and 1 3, a RAM which 
serves as a main memory for storing control programs 
executed by the CPU 1 1 and provides a work area used 
when the CPU 1 1 executes various types of control op- 

55 erations. Reference numerals 14 and 15 respectively 
denote a keyboard and a pointing device, which are 
used to input commands from the user. Reference nu- 
meral 16 denotes an external memory such as a hard 
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disk, which is used to store various application programs 
and data. Note that each application program stored in 
the external memory 16 is loaded into the main memory 
area ot the RAM 1 3 when it is executed by the CPU 11 . 
Reference numeral 17 denotes a display interface, 
which is connected to the stereoscopic display appara- 
tus 20 in this embodiment; and 18, a bus for connecting 
the respective components of the host computer 10 to 
each other. 

The stereoscopic display apparatus 20 includes an 
interface 21 for receiving a video signal and position in- 
formation indicating a stereoscopic display position from 
the host computer 1 0. Note that the video signal and the 
position information are respectively supplied to drivers 

22 and 23. The driver 22 controls a transmission type 
liquid crystal display 101 of the stereoscopic display ap- 
paratus on the basis of the input video signal to display 
an image corresponding to the video signal. The driver 

23 controls an electronic parallax barrier 1 03 on the ba- 
sis of the input position information to display a parallax 
barrier pattern in the stereoscopic display area indicated 
by the position information. Note that the transmission 
type liquid crystal display 101 and the electronic parallax 
barrier 1 03 are the same as those described with refer- 
ence to Fig. 19 When the electronic parallax barrier 103 
is driven, the stripes of the parallax barrier pattern are 
formed at fixed positions. That is, the display area for 
the barrier pattern is controlled in accordance with po- 
sition information, but the positions at which the black 
stripes can be produced are fixed. 

The communication unit constituted by the above 
interfaces 17 and 21 transmits the above video signal 
and position information. This communication unit may 
be a combination of a conventional video interface and 
serial interface (RS232C or the like) or a dedicated in- 
terface. In addition, the dedicated interface may use un- 
used connector pins of a conventional video interface. 

Note that above video signal includes both a gen- 
eral 2D image and a 3D image allowing a stereoscopic 
vision (e.g., the above striped image constituted by two 
types of parallax images). In this embodiment, 2D and 
3D images are displayed in units of windows. In addition, 
the above position information indicates the size and po- 
sition of the area in which the above stereoscopic image 
is present. If, therefore, a parallax barrier pattern is dis- 
played in 1he area, of the electronic parallax barrier 103, 
which is indicated by position information, and the image 
based on a video signal is displayed on the transmission 
type liquid crystal display 1 01 , the 3D image contained 
in the video signal can be stereoscopically viewed, and 
the general 2D image can be properly displayed. 

In this embodiment, an apparatus usingthe parallax 
barrier scheme will be mainly described. As is obvious, 
however, the present invention can also be applied to 
the Cyberbook (trademark) scheme described with ref- 
erence to Fig. 21 . Note that the Cyberbook scheme does 
not require the above position information because the 
host computer 10 and the stereoscopic display appara- 



tus 20 are integrated. 

In a stereoscopic display apparatus designed to al- 
low the observer to observe a stereoscopic image by 
using the parallax between the right and left eyes, the 
s images to be displayed on the image display screen are 
roughly classified into two types, i.e., a vertically striped 
parallax image and a horizontally striped parallax im- 
age. These images will be further described below. For 
example, Fig. 2 shows an image for the left eye; and 

10 Fig. 3, an image for the right eye. A vertically striped 
parallax image is obtained by dividing the images in 
Figs. 2 and 3 into vertical stripes, and alternately arrang- 
ing and synthesizing them. A horizontally striped image 
is obtained by dividing the images in Figs. 2 and 3 into 

1S horizontal stripes, and alternately arranging and synthe- 
sizing them (referring to Figs. 4 and 5, reference sym- 
bols L and R denote images for the left and right eyes, 
respectively). 

Each striped image can be divided into right and left 

20 images when combined with a directivity control means 
such as a barrier, a lenticular lens, or a striped polarizing 
plate. If, however, the directivity control means and a 
striped image are not set at proper relative positions, the 
right and left images are not observed with the corre- 

& sponding eyes, as described with reference to Figs. 22 
and 23. Since the directivity control means is a compo- 
nent incorporated in the stereoscopic display apparatus, 
the position of the means is basically fixed. In general, 
when an image is to be handled in a computer, a window 

30 which can be moved to an arbitrary position is opened, 
and the image is displayed in the window. For this rea- 
son, the directivity control means and the striped image 
may not be set at proper relative positions depending 
on the position of the window. 

35 Assume that in a stereoscopic display apparatus 
using vertically striped parallax images, right-eye strip 
images (the areas indicated by "R" and surrounded with 
the solid lines in a window 6) are superimposed on the 
right-eye image display areas (the areas indicated by 

40 "R" and surrounded with the dotted lines in a screen 7) 
of the directivity control means (coinciding with the 
screen 7 when viewed from the front surface side), as 
shown in Fig. 6. In this case, the observer can obtain a 
proper stereoscopic vision. In contrast to this, assume 

4B that the window 6 for displaying an image is located at 
the position in Fig. 7 within the screen 7, and the right- 
eye strip images (the areas indicated by "R" and sur- 
rounded with the solid lines in the window 6) are super- 
imposed on the left-eye image display areas (the areas 

so indicated by "L" and surrounded with the dotted lines in 
the screen 7) of the directivity control means. In this 
case, the observer cannot obtain a proper stereoscopic 
vision, but has a reversed stereoscopic vision (the left- 
eye image is seen with the right eye, and the right-eye 

55 image is seen with the left eye). 

To eliminate this inconvenience, in this embodi- 
ment, the following control is performed by the compu- 
ter. Fig. Bis a flow chart showing an operation procedure 



EP 0 860 729 A2 



10 



performed by the host computer in the first embodiment. 
In step SI 0, the host computer 1 0 detects that a window 
for stereoscopic image display is opened or its position 
is moved. In step S11 , the host computer 1 0 checks the 
position of the window after it is opened or moved to 
detect whether the window is at a proper position for a 
stereoscopic vision. That is, if the right-eye and left-eye 
image display areas determined with respect to the 
screen 7 coincide with the display positions of the re- 
spective images in the window 6, as shown in Fig. 6, the 
host computer 10 determines that the window is at the 
proper position. If the right-eye and left-eye image dis- 
play areas determined with respect to the screen 7 do 
not coincide with the display positions of the respective 
images in the window 6, as shown in Fig. 7, the host 
computer 10 determines that the window is at an im- 
proper position. Upon determining that the window is at 
the proper position, the host computer 1 0 continues the 
display state. Otherwise, the flow advances to step S1 2 
to automatically perform fine adjustment of the window 
position. Although not shown in the flow chart, if the 
opened or moved window is not for stereoscopic image 
display, the flow does not advance to step S1 1 and the 
subsequent steps. 

A method of detecting the generation or movement 
of a window and checking its position depends on the 
OS, the application, or the like used in the computer. 
Assume that an application which operates on "Win- 
dows 3. 1 " (trademark), which is an OS available from 
Microsoft Corporation, is to be created by using Visual 
Basic Ver.2.0 (trademark), which is an application de- 
velopment language available from Microsoft Corpora- 
tion. In this case, a window is recognized as an object 
called "Form". The generation of a window is defined as 
an event represented by Form_Load(), and the move- 
ment o( a window is defined as an event represented by 
Form_Paint(). If, therefore, a program is created such 
that when the execution of each event is confirmed, a 
function for detecting the position of the window (Form) 
is called, the current position of the window which is 
moved or generated can be obtained. 

A method of finely adjustingthe position of a window 
will be described next with reference to Figs. 9 and 10. 
Fig. 9 explains fine adjustment of a window position for 
a vertically striped parallax image. Fig. 10 explains fine 
adjustment of a window position for a horizontally 
striped parallax image. 

When a vertically striped parallax image is to be dis- 
played, the window is moved to the right or left by one 
stripe pitch in the horizontal direction, as shown in Fig. 
9. In many cases, the period of stripe images coincides 
with the minimum pixel pitch of an image display sur- 
face. In this case, therefore, it suffices if the window is 
moved to the right or left by one pixel. With this opera- 
tion, the reversed stereoscopic vision state is corrected 
to the proper stereoscopic vision state. 

When a horizontally striped parallax image is to be 
displayed, the window is moved up or down by one 



stripe pitch in the vertical direction within the screen, as 
shown in Fig. 10. In many cases, the period of stripe 
images coincides with the minimum pixel pitch of the im- 
age display surface. In this case, therefore, it suffices. if 
£ the window is moved up or down by one pixel. With this 
operation, the reversed stereoscopic vision state is cor- 
rected to the proper stereoscopic vision state. 

Assume that assignment information determined by 
the relative positional relationship with the electronic 
10 parallax barrier 1 03 as a directivity control means and 
indicating the assignment of positions, on the transmis- 
sion type liquid crystal display 101, where images for 
the right and left eyes are to be displayed are stored in 
the memory of the host computer 10 in advance. The 
?5 determination processing in step S11 is performed on 
the basis of this assignment information. The assign- 
ment information may be notified from the stereoscopic 
display apparatus 20 by communication, or may be held 
in a driver program added to the stereoscopic display 
20 apparatus 20. 

When a window is automatically moved in this man- 
ner, the amount of movement is very small in most cas- 
es. For this reason, such movement is hardly recog- 
nized by the observer. 
25 As described above, according to the first embodi- 
ment, there is provided a stereoscopic display which can 
automatically maintain a proper stereoscopic vision 
without attracting observer's attention. 

30 <Second Embodiment 

The second embodiment of the present invention 
will be described next. In the second embodiment as 
well, the present invention is applied to a stereoscopic 
35 display apparatus 20 which allows an observer to ob- 
serve a stereoscopic image by using the parallax be- 
tween the right and left eyes and a computer system 
including a host computer 10 for controlling the display 
apparatus. 

40 in the first embodiment, a proper stereoscopic vi- 
sion state is maintained by automatically moving a win- 
dow upon detection of the window position. In contrast 
to this, in the second embodiment, a proper stereoscop- 
ic vision is maintained by changing the contents of an 
45 image to be displayed after detection of the position of 
a window. 

Fig. 11 is a flow chart showing an operation proce- 
dure performed by the host computer in the second em- 
bodiment, in step S20, the hostcomputer 1 0 detects that 
so a window for stereoscopic image display is opened or 
its position is moved. Opening or movement of a window 
is detected in the above manner. In step S21, the host 
computer 1 0 checks the position of the window to detect 
whether the window is at a position where a proper ster- 
55 eoscopic vision is realized. If the window position is at 
a proper position, the current state is maintained If the 
window position is not at a proper position, the flow ad- 
vances to step S22 to automatically change the contents 
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of a displayed image. 

Processing of changing the contents of the dis- 
played image in step S22 will be described in detail next. 
Figs. 1 2 to 1 6 explain how the contents of the displayed 
image within the window are changed. s 

When the displayed image is a vertically striped par- 
allax image, one of the following changing operations is 
performed. 

(1) As shown in Fig. 12, the image in the window is 
moved to the right by one stripe pitch in the horizontal 10 
direction within the screen. Obviously, the image in the 
window may be moved to the left by one stripe pitch. 

(2) The image is displayed upon interchange of the 
L and R areas. 

In method (1 ), since the period of stripe images co- is 
incides with the minimum pixel pitch of an image display 
screen in most cases, the image is moved to the right 
or left by one pixel. In this case, the position of the win- 
dow is not changed, but only the image in the window 
is moved. 20 

When only the displayed image filling the window is 
moved, an area without any image data is inevitably dis- 
played. In such a case, this area may be displayed as 
a solid black area, as shown in Fig.. 1 3, 
Alternatively, as shown in Fig. 1 4, only an area smaller 25 
than the original striped image by one stripe in the hor- 
izontal direction is displayed in advance in the window, 
and the data in the area outside the window, which has 
not been displayed, is displayed when the image needs 
to be moved. In the case shown in Fig. 1 4, the image in so 
the window is moved to the left. 

In method (2), since the left and right images of the 
striped image are alternately arranged, the image is dis- 
played upon interchanging the left and right stripes. 

When, for example, the left-eye image (Fig. 2) and 35 
the righl-eye image (Fig. 3) are to be synthesized into a 
striped image, two types of images, i.e., the image in 
Fig. 4 and the image in Fig. 15, are generated by chang- 
ing the order of right and left stripes. If, therefore, one 
of the images is displayed, and a reversed stereoscopic <*o 
vision state occurs, a proper stereoscopic vision state 
can be set by interchanging one image and the other 
image. 

When the display image is a horizontally striped 
parallax image, one of the following changing opera- 45 
tions is performed. 

(1 ) As shown in Fig. 1 6, the image in the window is 
moved by one stripe pitch in the vertical direction within 
the screen (up-and-down direction). 

(2) The image is displayed upon interchanging the SO 
L and R areas. 

Since the contents of the changing operations are 
the same as those in the case of the vertically striped 
parallax image, a detailed description thereof will be 
omitted. £5 

In most cases, the contents of such a displayed im- 
age can be automatically changed by slightly moving the 
image. Therefore, the observer hardly recognize this 



729 A2 12 

movement. 

According to this embodiment as well, therefore, 
there is provided a stereoscopic display which can au- 
tomatically maintain a proper stereoscopic vision with- 
out attracting observer's attention. 

<Third Embodiment 

The third embodiment of the present invention will 
be described next. In the third embodiment as well, the 
present invention is applied to a stereoscopic display 
apparatus 20 which allows an observer to observe a 
stereoscopic image by using the parallax between the 
right and left eyes and a computer system including a 
host computer 10 for controlling the display apparatus. 

In the first and second embodiments, a reversed 
stereoscopic vision is prevented by moving or changing 
a displayed image. In contrast to this, in the third em- 
bodiment, a stereoscopic vision state is maintained by 
changing the state of a directivity control means upon 
detection of the position of a window. The stereoscopic 
display used in the third embodiment is therefore de- 
signed to actively change the relative positional relation- 
ship between the image display surface and the direc- 
tivity control means. In the parallax barrier scheme, for 
example, if the barrie r unit has a mechanism for allowing 
the unit to mechanically move while keeping parallel to 
the screen, such a state change can be made. Alterna- 
tively, the electronic parallax barrier may be designed to 
change the stripe display positions. 

Fig. 17 is a flow chart showing a control procedure 
performed by the host computer in the third embodi- 
ment. When the host computer 1 0 detects in step S30 
that a window is opened or moved, the flow advances 
to step S31 . In step S31 , if it is determined on the basis 
of the position of the window after it is opened or moved 
that the window is a window to be subjected to stereo- 
scopic image display, the host computer 10 checks the 
position of the window after it is opened or moved, and 
determines whether the window is at a position where 
a proper stereoscopic vision is obtained. If it is deter- 
mined that the window is at the proper position, the host 
computer 10 continues the current state. Otherwise, the 
flow advances to step S32 to automatically change the 
state of the directivity control means. 

The state of this directivity control means is 
changed as follows. 

When the displayed image is a vertically striped par- 
allax image, the directivity control means is moved to 
the right or left by one pitch of the periodic structure of 
the directivity control means in the horizontal direction 
within the screen. Note that the positions of the window 
and the image are not changed in this case. 

When a stereoscopic display which can generate a 
striped barrier pattern at an arbitrary position on the dis- 
play, as disclosed in Japanese Patent Laid-Open No. 
5-122733, is used, since a directivity control means can 
be electronically generated at an arbitrary position, the 
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above operation of changing the state of the directivity 
control means can be performed more easily. 

As described above, in the third embodiment, the 
relative positional relationship between a parallax barri- 
er and a striped parallax image is detected to automat- $ 
ically perform active control on the parallax barrier. 

When the displayed image is a horizontally striped 
parallax image, the directivity control means is moved 
up or down by one pitch of the periodic structure of the 
directivity control means in the vertical direction within 10 
the screen. The contents of this changing operation are 
the same as those in the case of the vertically striped 
parallax image. 

In most cases, the contents of such a displayed im- 
age can be automatically changed by slightly moving the j s 
image. Therefore, the observer hardly recognize this 
movement. According to this embodiment, similartothe 
first and second embodiments, therefore, there is pro- 
vided a stereoscopic display which can automatically 
maintain a proper stereoscopic vision without attracting 20 
observer's attention. 

<Fourth Embodiment 

The fourth embodiment of the present invention will 25 
be described next. In the first to third embodiments, the 
position of a window, the contents of an image, and the 
state of the directivity control means are changed in ac- 
cordance with the static window position. In the fourth 
embodiment, even when the position of a window dy- 30 
namically changes, a proper stereoscopic vision state 
is maintained by performing the above state changing 
operations. 

In general, when the cursor pointer of a mouse is 
placed on the title bar on the upper portion of a window 35 
and moved to a desired position in a clicked state, the 
window moves together with the cursor pointer as if the 
window is restrained by the movement of the mouse. An 
operation of moving a window together with the cursor 
pointer is called dragging. An operation of releasing a 40 
window by releasing the button at a proper position after 
dragging is called dropping. 

The position of a window dynamically changes in 
accordance with the movement of the cursor pointer 
while the window is dragged. This window and the im- 45 
age in the window may be kept displayed during this 
dragging operation. When, therefore, the image in the 
window is a striped parallax image, a reversed stereo- 
scopic vision must also be prevented during dragging of 
the window by some means. Fig. 18 is a flow chart show- so 
ing a control procedure for preventing a reversed ster- 
eoscopic vision during dragging of a window. When the 
start of the movement of a window by dragging is de- 
tected in step S41 , it is checked in step S42 whether the 
current position of the window is a position where a prop- 55 
er stereoscopic vision can be realized. If YES in step 
S42, the flow advances to step S44. 

If it is determined that the window is at a position 



where a reversed stereoscopic vision occurs, the flow 
advances to step S43 to execute a corresponding state 
changing operation In this case, the "corresponding 
state changing operation" indicates finely changing the 
window position (first embodiment), changing the con- 
tents of the image in the window (second embodiment), 
or changing the state of the stereoscopic (third embod- 
iment) which is described in the corresponding embod- 

The flowthen advances to step S441o check wheth- 
er the dragging operation is continued. If YES in step 
S44, the flow returns to step S42. If NO in step S44, this 
processing is terminated. 

Although the basic policy of the above processing 
does not greatly differ from that in the first to third em- 
bodiment, it should be noted that detection of the posi- 
tion of a window, verification of the window position, and 
a corresponding state changing operation are per- 
formed at very high speed. This is because, the position 
of a window incessantly changes from proper stereo- 
scopic vision position to improper positions while the 
window position dynamically changes owing to drag- 
ging, and the observer cannot continuously obtain a 
proper stereoscopic vision unless a corresponding state 
changing operation is performed to prevent a reversed 
stereoscopic vision everytime the window position is set 
at an improper position. In this embodiment, therefore, 
the window detection period during dragging is set to be 
very short to complete verification of the window position 
and a corresponding state changing operation within a 
period of time shorter than the above period. 

As described above, according to the fou rth embod- 
iment, there is provided a stereoscopic display which 
can automatically maintain a proper stereoscopic vision 
even while the observer is moving a window. 

As described above, according to each embodi- 
ment described above, in the computer system includ- 
ing the stereoscopic display apparatus which allows the 
observer to observe a stereoscopic image by using the 
parallax between the right and left eyes, and the host 
computer for controlling the display apparatus, when 
several windows are opened on the screen, and stere- 
oscopic images are displayed in the windows, the ob- 
server can always have a proper stereoscopic vision in 
a given window even if the position of the window chang- 
es. 

In both the parallax barrier scheme and the lenticu- 
lar scheme, position pixel unit width on the image dis- 
play surface corresponds to the eye width of the observ- 
er. Since an image having a size of several urn is en- 
larged into an image having a size of several cm, a one- 
pitch shift of the displayed image as in the above em- 
bodiments greatly influences the optimal observation 
position. That is, adjustment by such a one-pitch shift is 
very effective. 

Note that the present invention may be applied to 
either a system constituted by a plurality of equipments 
(e.g., a host computer, an interface device, a reader, a 
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printer, and the like), or an apparatus consisting of a sin- 
gle equipment (e.g., a copying machine, a facsimile ap- 
paratus, or the like). 

The objects of the present invention are also 
achieved by supplying a storage medium, which records 
a program code of a software program that can realize 
the functions of the above-mentioned embodiments to 
the system or apparatus, and reading out and executing 
the program code stored in the storage medium by a 
computer (or a CPU or MPU) of the system or appara- 
tus. 

In this case, the program code itself read out from 
the storage medium realizes the functions of the above- 
mentioned embodiments, and the storage medium 
which stores the program code constitutes the present 
invention. 

As the storage medium for supplying the program 
code, for example, a floppy disk, hard disk, optical disk, 
magneto-optical disk, CD-ROM, CD-R, magnetic tape, 
nonvolatile memory card, ROM, and the like may be 
used. 

The functions of the above-mentioned embodi- 
ments may be realized not only by executing the readout 
program code by the computer but also by some or all 
of actual processing operations executed by an OS (op- 
erating system) running on the computer on the basis 
of an instruction of the program code. 

Furthermore, the functions of the above-mentioned 
embodiments may be realized by some or all of actual 
processing operations executed by a CPU or the like 
arranged in a function extension board or a function ex- 
tension unit, which is inserted in or connected to the 
computer, after the program code read out from the stor- 
age medium is written in a memory of the extension 
board or unit. 

As has been described above, according to the 
present invention, 1he position of a striped parallax im- 
age as a stereoscopic image displayed in a window can 
be set at a position suited to the display apparatus. 

According to the present invention, therefore, when 
several windows are opened on the screen, and images 
are displayed in the windows as in the case of images 
handled in the computer, the observer can always have 
a proper stereoscopic vision in a given window even if 
the position of the window changes. 

As many apparently widely different embodiments 
of the present invention can be made without departing 
from the spirit and scope thereof, it is to be understood 
that the invention is not limited to the specific embodi- 
ments thereof except as defined in the claims. 



Claims 

1. An image display system capable of performing 
stereoscopic display, characterized by comprising: 

stereoscopic image display means (10, 21, 22, 



16 

101) for displaying a stereoscopic image hav- 
ing stripe parallax images arranged for right 
and left eyes; 

stereoscopic vision control means (10, 21, 23, 
103) for controlling directivity of the stereoscop- 
ic image such that stripe images of the stereo- 
scopic image are respectively observed with 
the right and left eyes; and 
changing means (S11, S12, S21, S22, S31, 
S32, S42, S43) for, when a relative positional 
relationship between the stereoscopic image 
and said stereoscopic vision control means is 
not a proper relationship with which an observ- 
er can obtain a proper stereoscopic vision, 
changing the relative positional relationship to 
realize a proper stereoscopic vision. 

2. The system according to claim 1 , wherein said ster- 
eoscopic image display displays a stereoscopic im- 

20 age in a window opened at a desired position within 
a display screen. 

3. The system according to claim 2, wherein said 
changing means moves the window by a distance 

£5 corresponding to a stripe pitch of the stripe image 
in, a direction of stripe width of the stripe image 
(S12). 

4. The system according to claim 3, wherein an 
30 amount of movement of the window is equal to a 

minimum pixel pitch of said stereoscopic image dis- 
play means. 

5. The system according to claim 3, wherein the stripe 
35 image is constituted by a horizontal stripe image in 

the screen, and a direction in which the window is 
moved is a vertical direction in the screen. 

6. The system according to claim 3, wherein the 
40 striped image is constituted by vertical stripe imag- 
es in the screen, and a direction in which the window 
is moved is a horizontal direction in the screen. 

7. The system according to claim 2, wherein said 
45 changing means moves the stereoscopic image in 

the window by a distance corresponding to length 
of a short side of each of the stripe images consti- 
tuting the stereoscopic image in a direction parallel 
to a short side of the stripe image (S22). 

so 

8. The system according to claim 7, wherein an 
amount of movement of the stereoscopic image in 
the window is equal to a minimum pixel pitch of said 
stereoscopic image display means. 

55 

9. The system according to claim 7, wherein the stripe 
image is constituted by a horizontal stripe image in 
the screen, and a direction in which the stereoscop- 



EP 0 860 729 A2 



17 EP 0 860 729 A2 18 



ic image in the window is moved is a vertical direc- 
tion in the screen. 

10. The system according to claim 7, wherein the 
striped image is constituted by vertical stripe imag- 
es in the screen, and a direction in which the ster- 
eoscopic image in the window is moved is a hori- 
zontal direction in the screen. 

11. The system according to claim 2, wherein said 
changing means interchanges odd and even stripe 
images constituting the stereoscopic image dis- 
played in the window. 

12. The system according to claim 2, wherein said 
changing means changes a relative positional rela- 
tionship between the stereoscopic image and said 
stereoscopic vision control means by changing said 
stereoscopic vision control means (S32). 

13. The system according to claim 12, wherein said 
changing means physically moves said stereoscop- 
ic vision control means. 

14. The system according to claim 12, wherein said 
stereoscopic vision control means comprises opti- 
cal directivity control means constituted by a spatial 
light modulation element which is electronically 
controlled, and 

said changing means electronically controls 
said optical directivity control means to shift a 
state of said control means to a state in which 
an observer can obtain a proper stereoscopic 
vision. 

15. The system according to claim 1, wherein said 
changing means is executed after the window is 
opened and a stereoscopic image is displayed 
therein or the window is moved. 

16. The system according to claim 1, wherein said 
changing means is executed at respective positions 
between movements of the window while the win- 
dow is moved. 

17. The system according to claim 16, wherein an ex- 
ecution period of said changing means is shortened 
while the window is moved. 

18. An information processing apparatus which can be 
connected to an image display apparatus having 
stereoscopic vision control means for controlling di- 
rectivity of a stereoscopic image to allow an observ- 
er to observe stripe images of the stereoscopic im- 
age with right and left eyes of the observer, respec- 
tively, characterized by comprising: 



generation means (11) for generating image 
data including a window in which stripe parallax 
images corresponding to the right and left eyes 
are arranged; 

£ determination means (11, S11 , S21, S31, S42) 

for determining whether a relative positional re- 
lationship between the window and said stere- 
oscopic vision control means of said image dis- 
play apparatus is a proper positional relation- 

10 ship which allows a proper stereoscopic vision; 

and 

adjustment means (11,812, S22, S32, S43) for, 
when said determination means determines 
that the relationship is not the proper relation- 
1S ship which allows a proper stereoscopic visjon, 

adjusting the relative positional relationship to 
allow a proper stereoscopic vision. 

19. The apparatus according to claim 18, wherein said 
20 adjustment means moves the window by a distance 
corresponding to length of a short side of the stripe 
image in a direction parallel to a short side of the 
stripe image. 

& 20. The apparatus according to claim 1 9, wherein an 
amount of movement of the window is equal to a 
minimum pixel pitch of said image display appara- 
tus connected to said information processing appa- 
ratus. 

21. The apparatus according to claim 19, wherein the 
stripe image is constituted by a horizontal stripe im- 
age in the screen, and a direction in which the win- 
dow is moved is a vertical direction in the screen. 

35 

22. The apparatus according to claim 19, wherein the 
striped image is constituted by vertical stripe imag- 
es in the screen, and a direction in which the window 
is moved is a horizontal direction in the screen. 

23. The apparatus according to claim 1 8, wherein said 
adjustment means moves the stereoscopic image 
in the window by a distance corresponding to length 
of a short side of each of the stripe images consti- 

4S tuting the stereoscopic image in a direction parallel 
to a short side of the stripe image. 

24. The apparatus according to claim 23, wherein an 
amount of movement of the stereoscopic image in 

so the window is equal to a minimum pixel pitch of said 
image display apparatus. 

25. The apparatus according to claim 23, wherein the 
stripe image is constituted by a horizontal stripe im- 

55 age in the screen, and a direction in which the ster- 
eoscopic image in the window is moved is a vertical 
direction in the screen. 
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26. The apparatus according to claim 23, wherein the 
striped image is constituted by vertical stripe imag- 
es in the screen, and a direction in which the ster- 

. eoscopic image in the window is moved is a hori- 
zontal direction in the screen. 

27. The apparatus according to claim 18, wherein said 
adjustment means interchanges odd and even 
stripe images constituting the stereoscopic image 
displayed in the window 

28. The apparatus according to claim 18, wherein said 
adjustment means changes a relative positional re- 
lationship between the stereoscopic image and said 
stereoscopic vision control means by changing said 
stereoscopic vision control means. 

29. The apparatus according to claim 28, wherein said 
adjustment means adjusts the relative positional re- 
lationship between the stereoscopic image and said 
stereoscopic vision control means by physically 
moving said stereoscopic vision control means. 

30. The apparatus according to claim 28, wherein said 
adjustment means adjusts the relative positional re- 
lationship between the stereoscopic image and said 
stereoscopic vision control means by electronically 
controlling optical directivity control means included 
in said stereoscopic vision control means and con- 
stituted by spatial light modulation element which is 
electronically controlled. 

31. The apparatus according to claim 18, further com- 
prising detection means for detecting that a window 
in which a stereoscopic image is to be displayed is 
opened or moved, and 

wherein said adjustment means is executed 
when said detection means detects that the 
window is opened or moved. 

32. The apparatus according to claim 18, further com- 
prising detection means for detecting movement of 
a window in which a stereoscopic image is dis- 
played, and 

wherein said adjustment means is executed at 
respective positions between movements of 
the window while the window is moved. 

33. The apparatus according to claim 32, wherein an 
execution period of said adjustment means is short- 
ened while the window is moved. 

34. A method of controlling an information display sys- 
tem having stereoscopic vision control means (10, 
21, 23, 103) for controlling directivity of a stereo- 
scopic image obtained by arranging stripe parallax 



images corresponding to right and left eyes of an 
observer to allow the observer to observe stripe im- 
ages of the stereoscopic image with right and left 
eyes, respectively, characterized by comprising: 

the stereoscopic image display step ( 1 0, 21 , 22, 
101) of displaying a stereoscopic image ob- 
tained by arranging stripe parallax images cor- 
responding to the right and left eyes; 
10 the detection step of detecting a relative posi- 

tional relationship between the stereoscopic 
image and said stereoscopic vision control 
means; and 

the changing step (S11, S12, S21, S22, S31, 
15 S32, S42, S43) of, when the relative positional 

relationship detected in the detection step is not 
a proper relationship which allows a proper 
stereoscopic vision, changing the relative posi- 
tional relationship to allow a proper stereoscop- 



35. A method of controlling an information processing 
apparatus which can be connected to an image dis- 
play apparatus having stereoscopic vision control 
means (10, 21, 23, 103) for controlling directivity of 
a stereoscopic image obtained by arranging stripe 
parallax images corresponding to right and left eyes 
of an observer to allow the observer to observe 
stripe images of the stereoscopic image with right 
and left eyes, respectively, characterized by com- 
prising: 

the generation step (11) of generating image 
data including a window in which stripe parallax 
images corresponding to the right and left eyes 
are arranged; 

the determination step (11 , S11 , S21 , S31, S42) 
of determining whether a relative positional re- 
lationship between the window and said stere- 
oscopic vision control means of said image dis- 
play apparatus is a proper positional relation- 
ship which allows a proper stereoscopic vision; 
and 

the adjustment step (11, S12, S22, S32, S43), 
when it is determined in the determination step 
that the relationship is not the proper relation- 
ship which allows a proper stereoscopic vision, 
adjusting the relative positional relationship to 
allow a proper stereoscopic vision. 

36. A storage medium storing a computer program for 
performing image display by using an image display 
apparatus having stereoscopic vision control 
means (10, 21, 23, 103) for controlling directivity of 
a stereoscopic image obtained by arranging stripe 
parallax images corresponding to right and left eyes 
of an observer to allow the observer to observe 
stripe images of the stereoscopic image with right 
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and left eyes, respectively, said computer program 
comprising: 

a code of the determination step (11, S11, S21, 

531 , S42) of determining whether a relative po- £ 
sitional relationship between a window in which 
stripe parallax images corresponding to the 
right and left eyes are arranged and said ster- 
eoscopic vision control means of said image 
display apparatus is a proper positional rela- n> 
tionship which allows a proper stereoscopic vi- 
sion; and 

a code of the adjustment step (11 , S12, S22, 

532, S43) of, when it is determined in the de- 
termination step that the relationship is not the is 
proper relationship which allows a proper ster- 
eoscopic vision, adjusting the relative position- 
al relationship to allow a proper stereoscopic 
vision. 
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(57) A stereoscopic image display apparatus for dis- 
playing a stereoscopic image, which is obtained by al- 
ternately arranging stripe parallax images R and L cor- 
responding to the right and left eyes, in a window in- 
cludes a parallax barrier (or a stereoscopic vision. When 
the display position of a window including a stereoscopic 



image which is set after the window is opened or moved 
and the positions of the right-eye and left-eye stripes of 
a parallax barrier have a relationship which does not al- 
low a proper stereoscopic vision, the display position of 
the window is moved by one stripe in the horizontal di- 
rection. 
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